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Introduction 


Military  Need  for  Crowd  Behavior  Research 


The  motivations  underlying 
adversarial  behavior 

Behavior  of  contested 
populations 

How  the  behavior  of 
populations  vary  cross- 
culturally 


If: 

U  1 

H 

What  is  innate  human 
behavior  that  extends  across 
cultural  boundaries 
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Introduction 


Crowd  Behavior  Research  at  TBRL 


•  Human  behavior  can  be 
explained  as  attractions  and 
repulsions  toward  and  away 
from  goals  (Lewin,  1935) 

•  Crowd  Behavioral  Test-Bed 
used  to  gather: 

-  locomotive 

-  psychosocial 

-  effectiveness  data 

•  Data  gathered  to  develop 
models  that  use  vector 
regression  methods  to  identify 
attributes  of  a  crowd  that 
influence  predictive  variables. 
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Data  Collection 


mm 


Experimental  Conditions 

Crowds  with  up  to  25  subjects  during  a  trial  throwing  simulated 
rocks  into  a  linear  target  while  the  target  was  defended  by  a  non- 
lethal  device: 

-  No  Defense  (Baseline) 

-  MRAD 

-  Handheld  stand-off  NLW  operated  by  Control  Force 

•  Simulated  Projectile  Weapon 

•  Simulated  Handheld  Directed  Energy  NLW  (VDE)  ^ 

-  Simulated  Invisibly  located  Directed  Energy  NLW  (IDE) 
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Model  Building 

•  MATLAB  modules  for  developing  software  to: 


-  Automate  the  creation  of  mathematical  models  for  motion  of 
individuals  in  a  crowd  from  the  data  collected  in  TBRL  crowd 
experimentation 


-  Run  simple  simulation  of  the  above  model  to  generate  simulated 
data 


-  Calculate  crowd  level  metrics  from  laboratory  and  simulated  data 

-  Compare  simulated  data  with  observed  data 


MODEL  -►  SIMULATION 


COMPUTE 

CROWD 

METRICS 


COMP.\RE  LAB 
TO  SIMULATION 
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Model  Building 


•  Pre-Process  Module 

-  Separate  modeling  and  validation  data 

-  Restructures  the  location  data  file 

•  Data  for  each  participant  at  sample  time  is  grouped  and 
appended  to  preceding  time  steps. 

*  Input  Module 

-  Parses  the  formatted  data  from  the  previous  step  into  three 
elements: 

•  Header  vector 

•  Output  matrix 

•  Predictor  matrix 
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Model  Building 


•  Modeling  Module 

-  Accepts  the  predictor  and  output  matrices 

-  Performs  non-linear  regressions  to  determine  the  relationship 
between  predictor/input  and  predicted/output  variables. 

•  [beta,  r,  J,  COVB,  mse]  =  nlinfit(X,  y,  fun,  betaO) 

•  Regression  of  velocity  vectors  in  both  ‘X’  and  ‘Y’  axes  against 
the  predictors,  generating  model  coefficients  for  change  in 
location  in  ‘X’  and  ‘Y’  coordinates 

-  Model  errors  were  fit  to  Weibull  distribution 
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Simulation 


*  Simulation  Moduie 


-  Execute  a  time  stepped  simulation  of  each  subject’s  location 
based  on: 

•  derived  model 

•  starting  conditions 

•  average  time  between  samples 

•  duration  of  simulation 

-  Calculate  the  following  for  each  subject  at  each  time  step  and 
appended  to  a  simulated  data  file 

•  delta  distance  traveled 

•  delta  position 

•  velocities 


-  Incorporate  Control  Force  effects  by  transforming  the  coordinates 
of  the  baseline  model  to  fit  that  of  the  CF  model, 


Distribution  A:  Approved  for  Public  Release 

TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


9 


Crowd  Metric  Analysis 


•  Crowd  Metric  Module 

-  Calculates  aggregate  metrics  of  crowd  behavior  as  a  whole 

•  Leading  edge  (LE):  location  of  the  forward  most  crowd  member 

•  Trailing  edge  (TE):  location  of  the  crowd  member  that  is 
furthest  back 

•  Centroid:  location  of  the  crowd  member  that  is  midway 
between  the  LE  and  TE 

•  Geometric  center:  mean  of  the  LE  &  TE 

•  Dispersion:  average  displacement  in  the  X  and  ‘Y’  direction 
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Model  Validation 


•  Model  Comparison 

-  Compares,  statistically,  the  crowd  metrics  of  simulated  and  observed 
data 

•  two  sample  Kolmogorov-Smirnov  (K-S)  goodness  of  fit  (GOF)  test 

•  Determine  if  the  simulated  data  follows  the  same  distribution  as 
the  observed  data,  the  asymptotic  p-value,  and  k-statistic. 

-  5%  significance  level 

-  Unequal  alternative  hypothesis  test 


Distribution  A:  Approved  for  Public  Release 

TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


11 


Distribution  A:  Approved  for  Public  Release 


Results 


Model  Verification 


•  RMSE  comparison 

-  Comparison  between  the  expected  values  calculated  from  the 
regression  equation  and  the  data  observed  in  the  laboratory. 


Condiflons 

RMSE  (Radial) 
[meters] 

RMSE  (Tangential) 

_ 

Baseliiie 

0.5 

Projectile  Weapon 

0.65 

0.54 

Visible  Directed  Energy 

0.47 

0.36 

MRAD 

0.37 

0.26 

bivisible  Directed  Energy 

0.37 

0.38 
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Model  Verification 


•  Graphical  Comparison 


Projectile  Weapon  Observed  Data 


^ ■ _ L _ _ I _ u 

^  -J  -2  0  2  J  6 


Distance  X-ditsclion  (m) 


Projeclile  Weapon  Simulated  Data 
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.IQi-. - . - ^ ^ - - - - - ^ 

^  .4  -2  0  2  4  6 
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Model  Verification 


•  Graphical  Comparison  Cont’d 


Oislance  X  ^iiedian  (m)  OislJnce  X  dtfKJion  (mj 
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Results 


Model  Validation 


•  K-S  GOF  Test 


Couditioiu 

Measures 

H 

[Accept(0) 

/Reject(l)] 

P-valiie 

K-S 

Statist 

ic 

Baseline 

LE 

0 

0.188 

0.500 

Centroid 

0 

0.519 

0.375 

TE 

0 

0.519 

0.375 

MRAD 

LE 

0 

0883 

0.286 

Centroid 

0 

0883 

0.286 

TE 

0 

0883 

0286 

Projectile 

Weapon 

LE 

1 

0  001 

0.714 

Centroid 

1 

1.19E-04 

0.786 

TE 

1 

1.87E-05 

0857 

Visible 

Directed 

Eneisv 

LE 

0 

0  07? 

0667 

Centroid 

1 

1.19E-04 

0.786 

TE 

1 

1.87E-05 

0857 

Invisible 

Directed 

Energy 

LE 

1 

1.87E-05 

0857 

Centroid 

1 

2.50E-06 

0.929 

TE 

1 

2.86E-07 

1.000 
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Results 


Model  Validation 


•  K-S  GOF  Test  -  Baseline 


Baseline  Leading  Edge  Baseline  Leading  Edge  CDF 


.41 - . - ^ ^ -  O' - “ - ■ - 

0  2  4  6  3-5  0  5 

Time  (sec)  Distance  (m) 


Baseiine  Centroid  Baseline  Cendroid  CDF 


Baseline  Trailing  Edge  Baseline  Trailing  Edge  CDF 
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Results 


Model  Validation 


•  K-S  GOF  Test  -  MRAD 


TiTie(s)  Distance(m) 


M  R  AD  Tra  iling  Edge  M  RAD  Traling  Edge  C  DF 
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Results 


Model  Validation 


K-S  GOF  Test  -  Projectile  Weapon 


Projectile  Weapon  Leading  Edge 


Projectile  Weapon  Leading  Edge  CDF 


Projectile  Weapon  Trailing  Edge 


Projectile  Weapon  Centroid 


Projectile  Weapon  Trailing  Edge  CDF 


Projectile  Weapon  Centroid  CDF 


Distance  (m) 
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•  There  are  several  identified  areas  for  improvement  which  include: 

-  Using  additional  or  new  regression  methods  that  yield  more 
accurate  models  reflected  by  smaller  RMSE 

-  Accounting  for  error  during  simulation  and  making  necessary 
adjustments  to  produce  data  that  more  closely  represent 
observed  data 

-  The  incorporation  of  crowd  metrics  for  the  observed  data  set  into 
the  model  development  process  to  improve  the  goodness  of  fit  for 
the  observed  and  simulated  data 

-  Using  additional  goodness  of  fit  test  to  validate  the  model 
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•  The  model  development  process  created  has  successfully 

-  created  models  from  Laboratory  collected  data 

-  simulate  models  over  time  to  generate  crowd  data  per  condition 

-  perform  analysis  of  observed  and  simulated  data 

-  compared  simulated  and  observed  data  against  crowd  behavioral 
measures 

•  The  process  allows  for  quantitative  means  for  validation  of  both  the 
mathematical  and  computational  models  against  empirical  data, 

•  The  models  created  for  the  baseline  and  the  MRAD  weapon 
conditions  successfully  estimated  crowd  locomotive  behavior 

•  Some  of  the  models  created  still  need  refinement  based  on  the 
graphical  comparison  of  the  simulated  and  observed  data  in  addition 
to  the  K-S  GOF  test 
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Questions  &  Answers 


Questions? 


US  Army  -  Target  Behavioral  Response  Lab 


Gladstone  Reid 
Picatinny  Arsenal,  NJ 
gladstone.v.reid.civ@nnail.mil 
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BACKUP  SLIDES 
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Crowd  Behavior  Testbed 


Courtesy  Vicon 

Distribution  A:  Approved  for  Public  Release 

TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


23 


